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We extend the merging model for undirected networks by Kim et al. [Eur. Phys. J. B 43, 369 
(2004)] to directed networks and investigate the emerging scale-free networks. Two versions of 
the directed merging model, friendly and hostile merging, give rise to two distinct network types. 
We uncover that some non-trivial features of these two network types resemble two levels of a 
certain randomization/non-specificity in the link reshuffling during network evolution. Furthermore 
the same features show up, respectively, in metabolic networks and transcriptional networks. We 
introduce measures that single out the distinguishing features between the two prototype networks, 
as well as point out features which are beyond the prototypes. 
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I. INTRODUCTION 

The subject of complex networks has recently caused 
a rapid surge of interest and already quite a few reviews 
have surfaced Q, 0, 0, 0, 0- While a large effort has 
been devoted to undirected networks, comparatively less 
attention has so far been payed on modeling directed net- 
works. On the other hand, there exist also many differ- 
ent types of real directed networks from various realm of 
sciencepl 03 ■ The directed networks-models dis- 
cussed in the present paper structurally resembles two ex- 
amples from biology i.e. metabolic networks H,000E3 
and transcriptional networks [Til If3 . Il3j . These two 
types, while being structurally rather different, both dis- 
play a broad out-degree distribution. 

The scale-freeness of the degree-distributions has been 
a central issue in the network research 0,0,0001- Typ- 
ical questions we can ask are: Does the feature of broad 
degree distributions observed in real networks suggest a 
common cause? Or does the broad distributions arise 
in a variety of ways, implying that no common cause 
exists? Can directed networks with scale-free degree dis- 
tributions be subdivided into " universality classes" based 
on relations between in and out-degrees in the networks? 

In the first step we try to find local organizational up- 
date rules, which automatically generate directed net- 
works with broad scale-free-like degree-distributions. We 
present two such local rules which we term friendly and 
hostile merging. We further characterize the two emerg- 
ing types of directed scale- free networks by measures con- 
nected to the relative amount of and the relations be- 
tween in- and outgoing links. We notice that directed 
networks have more characteristic features than undi- 
rected ones which make it easier to detect differences 
between them. Next we introduce two minimalistic ran- 
dom network models which display features reminiscent 
of the two types of networks obtained from, respectively, 



friendly and hostile merging. We clarify the similarities 
and differences and suggest that the common overall fea- 
tures can be described in terms of two distinct prototypes 
of directed scale-free-like networks. Finally we compare 
with two real directed networks i.e. metabolic networks 
and transcriptional networks and discuss the similarities 
and differences. 



II. FRIENDLY AND HOSTILE MERGING: 

Recently Kim et al in Ref. 01 constructed a local up- 
date rule of merging type for undirected networks which 
automatically gives rise to scale- free degree distributions. 
We here extend this local merging evolution to directed 
networks and describe and discuss two alternatives called 
friendly and hostile merging. 



Friendly Merging: Friendly merging is an example 
of a local update which automatically gives rise to scale- 
freeness and, as we will discuss, a prototype of directed 
networks. A specific context could, for example, be the 
situation when companies invest money in other compa- 
nies. If company A has invested in company B there is a 
link from A to B. A may for example be a big company 
with a large turnover represented by a lot of in and out- 
links, whereas B could be a small company with just a 
few links. The friendly merging describes how companies 
buy up each other and new companies are started from 
scratch until a steady state has been reached where the 
average size of the companies is constant. 

The specific local update rule for friendly merging is 
illustrated in Fig. ^ and can be described as follows: 

a) Choose a node: Randomly pick a node, i, with in- 
and out degree ki t i n and ki >0 ut- 



b) Che 



node to merge with: Randomly pick one 



of its neighbors, j, with in- and out-degree kj^ n and 
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FIG. 1: Friendly Merging: a) Node i is randomly picked to 
merge with one of its out- link neighbors, j: b) Node i gets all 
the links that are connected to j except the ones they have 
in common and the ones pointing to each other (N CO mmon,in 
and N com mon,out), so one node and two links are taken away 
from the system shown in the figure. Node i thus gets the 



in- and out-degree, fcj.in = fa,in + 



N 



common, in 



and 



k%,out — ki,out ~\~ kj, ut N CO mmon,out> respectively, c) One 
node and two links are put in at random to keep the system 
size constant. 



c) Merging step: Move all the links (in- and out- 
links) connected to j, so that they connect to i 
instead. Node i will then have the in- and out- 
degrees kii n = kii n + k 

ki.out — k-i ou f -\- kj^out 

Here N commonin / out is the number of links which 
the nodes i and j have to common neighbors (in- 
cluding the one to each other). Since only at most 
one link of each direction between two different 
nodes are allowed, these in- and out-degrees disap- 
pear. This reflects the efficiency gain in the merging 
step. 



7,J« 

common, out) respectively. 



d) Balance step: Add a new node with degree zero, 
h,in = h,out = 0, and then add r links that 
connect randomly into the system. This step en- 
sures that the number of nodes is constant and 
that the number of links reaches an equilibrium 
value after going through the updating steps many 
times. The equilibrium value of the links is thus 
controlled by the parameter r. In equilibrium 

\N common, in ~t~ ^ common, out) • 

Here, "()" denote the average. We start from an Erdos- 
Renyi(ER)-network (see e.g. Q) and apply the merging 
update until equilibrium is obtained. We use the size 
N = 1000-nodes for the simulations of model networks 
in order to facilitate comparison with the real networks 
in the paper, which have approximately this size. For 
r = 3 we obtain (k in ) = (k out ) ~ 4. Figure |21 gives the 
characteristics of this merging network obtained by aver- 
aging over many equilibrium networks (for the merging 
models we use 1 00 networks whereas in model A and B 
we use 10000 networks). As demonstrated by Fig. Ufa), 
the in- and out-degree distributions P ut{k ut = Pin(ki n ) 
are equal and "scale- free" like, i.e. can be approximated 
by a power law over a substantial range (see Fig.|2|[a)) Q. 
The scale-freeness is a truly non-trivial emergent prop- 
erty whereas the fact that P ou t(k ut is equal to Pi n (ki n ) 
basically reflects the symmetry between in- and out- 
links in the friendly merging scheme (note however the 
slight asymmetry introduced by choosing the neighbor 
link from an out-link, discussed in connection with Fig. 
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FIG. 2: (Color online) Friendly Merging: a) Cumulative 
degree-distribution P(> k) = f°° dkP(k) for 7 « 2.3 and 
(kin) = (kout) ~ 4.0 (corresponding to r = 3 in the up- 
date rule): b) Demonstration that (k in ) out = k out to good 
approximation: c) Demonstration that the spread goes as 
Sin(kout) <x k~^/ 2 to good approximation; full line Eq. 
and data points from simulations. The cut-off for large k ou t 
is a finite size effect, d) Proportion of links with in-, out-, and 
both in- and out-links. 



Etd)). Fig- El^b) demonstrates a second non-trivial prop- 
erty: the average number of in-degrees for nodes 
with a fixed out-degree k out is closely equal to k ou t- By 
contrast the random ER-network gives a horizontal line 

{kin) out (kin) ■ 

In order to get some insight into the origin of this sec- 
ond non-trivial property we introduce the concept of a 
random scale-free network: The assumption is that the 
total number of links ki„ + k out on a node is given by the 
same distribution as ki„ and k ou t- This assumption is ful- 
filled in case of friendly merging. Next we assume that 
the numbers of in- and out links on a node of size k are 
randomly distributed and that the distribution for k is 
scale-free. The relation between in-and out-degrees on a 
node, can then be understood by ignoring the constraint 
implicit in having a connected network. We instead con- 
sider the nodes as boxes of certain sizes (degrees), k, and 
with the size distribution P(k). We then put in red and 
blue balls (respectively, in- and out-links) into the boxes 
until they arc filled. In such a case the average number 
of in-links (red balls) on a node with precisely fc out out- 
links (blue balls), (fcm}fc outJ is just given in terms of the 
binomial distribution B(ki n , k) i.e. the probability to get 
ki n tails when tossing a coin k = k- m + fc out times: 



(kin)k aut — 



Ekmax 
k=k a 



B[k - k out ,k)P(k)(k - k out ) 



Et=Z ut B(k-k out ,k)P(k) 



(1) 
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FIG. 3: (Color online) Hostile Merging: a) Node i is randomly 
picked to merge with one of its out-links neighbors, j. b) Node 
i gets all the out -links that are connected to j except the 
ones i and j have in common neighbors. The in-links to j are 
randomly rewired to other nodes (excluding i). This means 
that one node and two links are taken away from the system. 
Node i thus gets the in- and out-degree, ki^n = fc,m and 
ki,out = h,out + kj !OU t — N comm0 n,out- c) One node and two 
links are put in at random to keep the system size constant. 



where k is the total number of links attached to a node 
(so that fc; n = k — k out ), and k max is the largest node in 
the network. Here P(k = k m + k out ) is the probability of 
picking a node of size k. For a the case of P(k) oc 1/fc 7 
one then finds (fci n ) « fc out (the analytical solution for 
7 = 2 gives (k- m ) = ^out — 2 to leading order of large 

&out ) ■ 

We pursue this property of random scale-free networks 
one step further and study the spread of the fcj n -links for 
the nodes with a given number of k ou t- For this spread 
we use the measure 

Q fu \ ^(fcinlfcout) l fc " ~ ( fc '")fc^ 

Oin{K ou t) — — J, r \£) 

N k ov , t {kin)k ont 

Using the same simplification as in Eq. then gives 
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B(k~k out ,k)P(k) 



(3) 



For a random scale-free distribution this gives 
S'i n (fcout) oc fc out , whereas for the ER-network the spread 
is independent of fc out i.e. Si n (k out ) = const. The spread 
obtained from friendly merging is plotted in Fig. OJc) 
(with the use of Eq. |2J together with the analytical re- 
sult obtained from Eq. J3J). The sharp change in the slope 
of the analytical result in Fig.^c), at large k out , is a fi- 
nite size effect. The drop occures when k out rs k max /2. 
Figures |21 (a)-(c) show that friendly merging essentially 
gives rise to a random scale-free network. 

Finally in Fig.|3i we give the percentage of nodes with 
only in-links, nodes with only out-links and nodes with 
both in- and out-links. One notes that friendly merging 
gives rise to a slightly larger percentage of nodes with 
only in-links than with only out-links. This asymmetry 
is caused by always picking an out-link neighbor in the 
update rule a) for Friendly merging. Among the nodes 
with both in- and out-links a total of 12 % have double 
links (a double link e.g. means that company A and B 
has mutually invested in each other). 
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FIG. 4: (Color online) Hostile Merging: a) Cumulative 
degree-distribution P ut(> kout) and Pi n {> km) obtained for 
(k) ~ 3.8 (this particular value was chosen in order to fa- 
cilitate comparison with the yeast network in Fig. |5J which 
corresponds to r = 1.5 in the local update (the dotted straight 
line has the slope —1.7). b) No correlations between (ki n ) ou t 
and kout for the fc otl t-nodes because (k m )out = (kin) indepen- 
dent of kout- c) Also the spread Si n {k ut) is independent of 
kout- d) Proportion of links with in-, out-, and both in- and 
out-links. 



This constitutes our description of friendly merging 
and the characteristics of the directed network it gives 
rise to. Next we turn to an alternative local update rule 
termed hostile merging. 

Hostile Merging: The alternative update rule, hos- 
tile merging, can also be described in terms of the com- 
pany analogy: In this case company A makes a hostile 
takeover and acquires all the assets of company B. The 
companies that had money invested in B prior to the 
takeover will not be allowed to have any control over A. 
So in this case these companies will be forced to sell their 
parts in company B to A and invest the money elsewhere. 
In terms of networks this means that a node gets all the 
out-links from the neighbor it merges with. This can be 
translated into the following update rule: 

a) Choose a node: Same as for friendly merging. 

b) Choose a node to merge with: Same as for friendly 
merging. 

c) Merging step: Move all the out-links connected to 
j, so that they connect to i instead and move all 
the in-links of j so that they randomly connect to 
other nodes (excluding i). Links sitting between i 
and j before the merging are deleted. Node i will 



then have the in- and out degrees k% 



(or 
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1, if a link from j to i existed) and 

ki,out ki,out ~t~ kj,out A r common ,out ? respectively. 
Here N common out is the number of out-links which 
the nodes i and j have to the same neighbors. 

d) Balance step: Same as for friendly merging. 

The hostile merging update rule is illustrated in Fig. 
[3] and in Fig. 0] we present the characteristic features for 
the network emerging from this evolution rule. 

As seen from Fig.0]networks arising from hostile merg- 
ing are characterized by a broad "scale- free" -like out- 
degree distribution and an ER-like in-degree distribution 
with no correlation between the number of in- and out- 
degrees on the nodes with a given number of in- or out- 
degrees. There is again a large portion of links with both 
out-and in-degrees (52% as compared to 69% for friendly 
merging). However the asymmetry between links with 
only in- and only out-degrees is huge for hostile merging 
(45% for only in and 3.2% for only out) and the propor- 
tion of nodes with double links is 14%. 

The networks arising from hostile merging and friendly 
merging are thus very different. The common feature is 
basically that the out-degree distribution is scale- free-like 
in both cases. We will in the following argue that the 
two different types of networks arising from friendly and 
hostile merging can in fact be viewed as two prototypes 
of directed networks connected to scale-freeness. 
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FIG. 5: (Color online) Model A: a) Cumulative degree- 
distribution P(> k) = dkP(k) for 7 « 2.3 and (k) w 1.9: 
b) Demonstration that (ki n ) ou t = k ou t. (An ER-network has 
instead {k in ) out = (k)/2). c) Demonstration that the spread 

goes as Sin(kout) oc k~^( 2 . full line Eq. and data points 
from simulations. The cut-off for large k out is a finite size 
effect, d) Proportion of links with in-, out-, and both in- and 
out-links. 



III. MODEL A AND B 

So far we have constructed two local evolution rules 
and found that the two types of emerging directed net- 
works both display scale-free features but are otherwise 
different. In this section we show that the overall fea- 
tures of these two network types can be connected to 
two minimalistic random scale-free network-models. We 
suggest that these two minimalistic network models can 
be viewed as two prototype models. 

Model A: Model A is constructed as follows: We 
start from a scale- free undirected connected network with 
a degree-distribution P(k) oc fc -7 and with average de- 
gree (k) (which means that in the limit of very large sys- 
tems (k) = (7 — l)/(7 — 2)). This scale-free undirected 
network is constructed by the Stub algorithm followed by 
a random rewiring [la , H61 Il7j . Next we randomly assign 
directions to links with equal probability. Such a network 
has the following obvious property: The in-degree and 
the out-degree distributions are equal, P{ki n ) = P{k out ) 
and both proportional to fc -7 . Finally, we separately 
rewire the in- and out-end of the links randomly without 
changing the scale-free distributions. Figure E^a) shows 
that the resulting distributions are indeed equal and scale 
free. Figure EJb) demonstrates that (k in ) w fc out (the 
deviation for large fc out is a finite size effect). This ex- 
plicitly links this relation to networks where the in- and 



out-degree distributions are both scale- free and equal and 
an average is taken over a large ensamble of networks (as 
explained in connection with Eq. Q). In the same way 
Fig. |S{c) connects the spread predicted by Eq. © for 
equal scale-free in- and out-degree distributions to the 
result obtained from simulation of model A (full curve in 
Fig.JSJc), the inset shows the corresponding result for an 
ER-nctwork). We find that model A is a random min- 
imalistic model with the essential characteristics of the 
friendly merging networks (compare Fig.[5J). Figure|3Id) 
gives the proportions of nodes with only in-, only out- and 
both in- and out-links. Comparing with friendly merg- 
ing in Fig. Hid), we notice that the number of only in- 
and only out-nodes is somewhat larger for Model A and 
that there is a perfect symmetry in contrast to the slight 
asymmetry discussed in connection with friendly merg- 
ing. Our conclusion is hence that friendly merging shares 
its overall characteristics with model A. 

Model B: The minimalistic model B, displaying 
common characteristics with the hostile merging net- 
works is constructed as follows: We again start from a 
scale free distribution of the total node degree P(k) oc 
fc~ 7 (the total degree distribution is the same as for hos- 
tile merging for better comparison) and randomly assign 
directions on the links. Next we make a random rewiring 
on the links keeping the out-degree distribution intact, 
but rewiring without this restriction for the in-degrees. 
This means that P(k ou t) oc k~J t whereas the in-degree 
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FIG. 6: (Color online) Model B: a) Cumulative scale-free 
degree-distribution P ut{> k out ) for 7 w 1.7 and {k out } ~ 3.8 
together with the ER-like Pi n (> kin), b) No correlations be- 
cause (k in )out = (k in ) independent of k out . c) The spread 
Si n (kout) independent of k out for the same reason, d) Pro- 
portion of links with in-, out-, and both in- and out-links. 



distribution becomes ER-like. Model B is consequently 
by construction a prototype of a random model where the 
out-degree is scale-free and the in-degrec is of ER-type. 

The general characteristics of model B is shown in Fig. 
|S]for 7 = 1.7 and (k) w 3.8. Figure^a) shows the scale- 
free broad out-degree distribution and the narrow ER- 
type in-degree distribution. Figure Elb) illustrates that 
there is no correlation between in and out-degrees for 
nodes with a given fixed number of k out . This follows be- 
cause by construction the average in-degree on any node 
is (ki n ) = (k)/2 regardless of the number of out- links 
(compare Model A and Fig.^b)). As a consequence the 
spread in Fig.^c) is independent of k out (compare Model 
A and Fig. [Sic)). Finally, Fig.[|Jd) shows the percentage 
of in- and out-degrees on the nodes. By comparing Fig. 
[5] with Fig. we find that model B catches the overall 
features of the hostile merging networks. 



IV. METABOLIC AND TRANSCRIPTIONAL 
NETWORKS 

Do the two prototypical properties A and B found in 
respectively friendly and hostile merging also show up 
in real networks? We here demonstrate that they indeed 
do, with A showing up in biological production networks, 
i.e. metabolic networks, while B rather is found in infor- 
mation processing networks like the transcriptional net- 
works. 



FIG. 7: (Color online) Metabolic Networks: Average over 107 
metabolic networks with data obtained from Ref. (H). The 
same characteristics as for Model A and Friendly Merging: a) 
Cumulative degree-distribution P(> k). The dashed straight 
line line has the slope 7 = 2.3 and (ki n ) = (k out ) ~ 4.3. b) 
Plot of (ki n ) ou t versus k ou t showing that the data is consistent 
with (kin)out — k out . c) Demonstration that the spread goes 
as Sin(kout) oc k~^/ 2 to reasonable approximation, full line 
from Eq. ||3J and data points from simulations. The cut-off 
for large k ou t is a finite size effect, d) Proportion of links with 
in-, out-, and both in- and out-links. 



Metabolic networks: The first example is the av- 
erage properties of 107 metabolic networks with the av- 
erage size (N) ?s 940 (data taken from Ref. @). A 
metabolic network is constructed as follows: Substrates 
and products in the metabolism are nodes. Two nodes 
are connected if the first substance is a substrate in a 
metabolic reaction which produces the other substance. 
The links points from the substrate to the product. The 
data are obtained as the average over 107 such networks 
and consequently reflect an ensemble average network 
structure associated with metabolic networks 01- Fig" 
ure Efa) shows that, just as for friendly merging and 
model A, metabolic networks have P ut(k out ) = -Pm(fcm) 
and has a broad scale- free degree-distribution as was first 
demonstrated in Ref. Q. Furthermore from Fig. |7fb) 
and (c) we conclude that also for the ensemble average 
of metabolic networks to good approximation the rela- 
tion (ki n ) ~ kout holds. Also the spread has a similar 
decrease as in case of friendly merging and model A. In 
addition the relative proportions of links on a node cor- 
responds very well for metabolic networks and friendly 
merging (compare Fig[7Jd) and Fig(2td) and notice that 
these two networks also have approximately the same 
number of average links). We conclude that the over- 
all structure of metabolic networks belong to the same 
network class as A and friendly merging. 



6 



a. 



10" 



10 



10 



10 



N 

\ 


Yeast Out — 
In -- 
y= 1.7 




,\\ 

\ \-.. 




(a) 


\ \ 

i \ 
\ L 

. . u , 



10° 10 1 10 2 




20 40 60 80 



10' 



10 





Yeast o 
1.2 — 


a o 






— o— e ■ 



CP 


(c) 





Yeast 



Out: 21.8% 



In: 69.4%, 



(d) 




10" 



10' 



FIG. 8: (Color online) Transcription networks for yeast (data 
from Ref. [Til H^H . The same characteristics as for Model 
B and Hostile Merging, a) Cumulative degree-distribution 
Pout(> k out ) and Pi„(> kin) showing a broad distribution 
for the out-degrees (the dotted line is for comparison with 
hostile merging and has the slope 7 w 1.7) and an ER-like 
distribution of in-links. b) Shows that there are no correla- 
tions between {k in )out and k out for the fc out -nodes. c) Also 
the spread Si„(k out ) is independent of k out . d) Proportion of 
links with in-, out-, and both in- and out-links. 



Transcriptional networks: Figurc[S]shows the cor- 
responding analysis for the network of transcriptional 
protein-protein regulations for yeast(Saccromyces Cere- 
visiae, data from Ref. 0,0). Comparing Figs. Eta)- 
( c )iEI a )-( c ) and |Sfa)-(c), shows the common feature of 
a broad out-degree and an ER-like in-degree. The ER- 
like character for the in-degree of yeast is emphasized 
by the lack of correlations displayed by Figs. OUb) and 
(c) . Overall we see that transcriptional networks belongs 
to the class characterized by model B. However, there 
are also differences: the out-degrec for the yeast-network 
is broad but not very scale-free and the percentages of 
degrees in Fig.^Jd) on the one hand are significantly dif- 
ferent as compared to hostile merging and model B on 
the other hand. 



two minimalistic models contain the same overall charac- 
teristics as, respectively, the friendly and hostile merging 
networks. We compared metabolic and transcription net- 
works from real data with the two prototypes and found 
that the properties of metabolic networks has the same 
overall characteristics as model A and the friendly merg- 
ing network. However, the yeast transcriptional network 
resembled model B and hostile merging networks. This 
led us to suggest that friendly- and hostile merging net- 
works represent two distinct classes of directed networks. 

What might be the implication of these results? Even 
if friendly merging and metabolic networks are similar, 
we do not suggest that the friendly merging evolution 
rule (which may be motivated in an economical con- 
text) has direct correspondence to the actual evolution 
of metabolic networks (which has to do with production 
handling). The implication is rather that scale freeness 
can arise in a variety of explicit ways. However, it was 
also shown that an ensemble of random scale-free net- 
works bring additional non-trivial properties like a rela- 
tion between in- and out-links on a node. Comparison 
between the ensemble average of metabolic networks im- 
plies that this latter property is in fact shared with the 
metabolic networks. This imposes restrictions on the evo- 
lution and the correlations of individual metabolic net- 
works. 

Since scalc-frcencss is a common property and since 
ensemble averages of real directed networks show strong 
similarities with random scale-free networks, there obvi- 
ously is a need for further distinguishing network mea- 
sures. In the present paper we suggest and discuss one 
such measure: The percentage of nodes of different num- 
ber of only in-, only out-, both in- and out-links. 0] We 
found a close correspondence between the friendly merg- 
ing network and the ensemble average of metabolic net- 
works. 

In summary we uncovered two distinct classes of di- 
rected networks A and B. In case of friendly and hos- 
tile merging we suggest that the distinction between A 
and B might reflect a difference in economical strategy. 
For biological networks we suggest that the distinction 
instead reflects a functional design difference associated 
with handling production (metabolic networks) and in- 
formation processing (transcriptional networks). 



V. CONCLUSIONS 

We present and characterize two directed network- 
types emerging from two different local time-evolutions 
called friendly and hostile merging. It was shown that 
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